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Abstract 


We consider a class of infinite two-player games on 
finitely coloured graphs. Our main question is: given a 
winning condition, what is the inherent blow-up (additional 
memory) of the size of the I/O automata realizing winning 
strategies in games with this condition. This problem is rel- 
evant to synthesis of reactive programs and to the theory of 
automata on infinite objects. We provide matching upper 
and lower bounds for the size of memory needed by win- 
ning strategies in games with a fixed winning condition. We 
also show that in the general case the LAR (latest appear- 
ance record) data structure of Gurevich and Harrington is 
optimal. Then we propose a more succinct way of repre- 
senting winning strategies by means of parallel composi- 
tions of transition systems. We study the question: which 
classes of winning conditions admit only polynomial-size 
blowup of strategies in this representation. 


1 Introduction 


We consider games played on (not necessarily finite) 
graphs coloured with a finite number of colours [15, 23]. 
The two players alternatively choose vertices forming an 
infinite path through the game graph. The winner is estab- 
lished by a Muller winning condition (defined on the finite 
set of colours). 

These games can be seen as a special case of general 
Borel games and were first studied by Btichi and Landwe- 
ber [4]. Gurevich and Harrington in their seminal paper [11] 
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have shown that if a player has a strategy in such a game 
then there is a winning strategy for her that uses only finite 
information (memory) about the history of the play. 


Since this result, infinite games became a central tool in 
the theory of automata on infinite objects [9, 13, 23, 19, 
20]. They were also used in understanding logics of pro- 
grams [9, 18, 21]. It was also observed that a game may be 
considered as a specification of a reactive system by view- 
ing it as a description of all possible interactions between 
player O (Control) and player 1 (Environment). A winning 
condition in a game specifies some requirements on the be- 
haviour of the reactive system (for example some liveness 
properties). In this metaphor, a winning strategy can be 
seen as a program Satisfying the specification. Hence, in 
this framework, strategy construction amounts to program 
synthesis and deciding if there exists a winning strategy for 
player 0 is equivalent to the problem of realizability of spec- 
ifications of reactive systems. These problems were studied 
for example in [1, 4, 14, 17]. 

In all these applications an important question is how 
much memory a strategy may need. As an example from 
automata theory, consider the complementation lemma for 
automata on infinite trees. There, in the construction of the 
automaton accepting the complement of the language, one 
takes as states subsets of the set of pairs: (state of the orig- 
inal automaton, memory state of the strategy). Hence the 
size of the required memory influences the size of the au- 
tomaton for the complement. In particular it can change this 
size from single to double exponential. In the area of pro- 
gram logics, additional memory reflects in complications 
in proof constructions as for example in [21] or in tableau 
constructions [3, 6]. In these applications it is important 
to understand the structure of the additional memory. Un- 
til now essentially the only known memory structure were 
LAR’s [11, 15, 23]. 

Most importantly, however, the question of memory size 
is crucial in the program synthesis. It measures the inher- 
ent blow-up of the size of a program satisfying a specifica- 
tion in terms of the size of the specification itself. In order 


to understand feasibility of program synthesis, as described 
above, it is hence important to classify winning conditions 
according to the blow-up in the size of strategies they may 
incur. 


In some applications it is necessary to deal with in- 
finite game graphs, e.g., when proving complementation 
lemma for automata on infinite trees. When considering 
program synthesis, however, one usually takes into account 
game graphs of size at most polynomial in the number of 
colours in the winning condition. (Although finitely defin- 
able infinite size games also were considered in this con- 
text [5, 20, 22] and our results are also applicable there). 
As we will see the case when the size of the game graph 
is bounded in the number of colours is different and tech- 
nically more difficult, hence it is appropriate to consider it 
separately. We will consider the problem: how much mem- 
ory is needed to win games with a given class of winning 
conditions. We will consider both, the case when we bound 
the size of games by the number of colours in the condition 
and the case when we do not impose this bound. 


It is well known that there exists a sequence of games 
{(Gn)nen, each Gn of size O(n) and requiring strategy au- 
tomata of size 2” [20, 12]. Hence synthesized program may 
be exponentially larger than the specification. While it is 
still possible to imagine that we can deal with problems 
having worst case exponential time complexity, it is hard 
to imagine how we can cope with exponential space com- 
plexity. Indeed in the model checking community it was 
discovered that the space, not time, complexity is the major 
obstacle. To overcome the problem of big sizes of strategies 
we propose a new representation of strategies. This rep- 
resentation is inspired by a well known problem in model 
checking, namely, the state explosion problem. 


Very often, reactive programs are presented as a parallel 
composition of sequential programs, where each sequential 
program is represented as a finite I/O automaton. It is well 
known that the size of the resulting space depends expo- 
nentially on the number of parallel components. This is 
a major obstacle in applying model checking techniques. 
Here, in the context of synthesis, we propose to use this 
phenomenon to our advantage. We suggest to describe, po- 
tentially big, strategy automaton as a parallel composition 
of, possibly small, components. We call this representation 
a p-automaton. There are examples when one can obtain 
exponential savings using p-automata. Indeed it is very dif- 
ficult to come up with examples of games that need expo- 
nential size strategies in terms of p-automata. Such games 
must exist by a counting argument but giving a concrete 
example of such a game would imply a solution to one of 
the major problems about nonuniform complexity classes. 
The problem is to give an explicit description of a function 
h: {0,1}* — {0,1} that is not computable in nonuniform 
NCI. 


1.1 Overview of the results 


First we consider the case when we do not limit the size 
of game graphs in terms of the number of colours in the 
winning condition. We define the size of the memory of 
a strategy as number of states of an I/O automaton realiz- 
ing the strategy. In this case we obtain matching upper and 
lower bounds for any fixed winning condition F, i.e., we 
determine a number mg such that: 


1. For every game with the winning condition F, memory 
of size mg is sufficient for a winning strategy in this 
game. 


2. There exists a game with the winning condition F for 
which every winning strategy requires memory of size 
at least mg. 


If we restrict ourselves to game graphs of size polyno- 
mial in the number of colours in the winning condition then, 
clearly, the upper bound still holds. General lower bounds, 
however, do not follow from the above, because our games 
requiring memory of size mg have graphs roughly of size 
msg (which may be exponential in the number of colours). 
We, however, provide a particular lower bound, that estab- 
lishes optimality of LAR’s also in this setting: 


3. There exists a sequence of games (S,,) nen, such that 
the game graph of §,, is of size O(n) and every win- 
ning strategy requires memory of size n!. 


In the last section we consider the problem of repre- 
senting strategies by means of p-automata. We show that 
the strategies in the games §,, from (3) can be represented 
by polynomial size p-automata. Indeed polynomial size p- 
automata realising winning strategies exist for all games 
with winning conditions that can be represented by a Tur- 
ing machine working in a space polynomial in the number 
of colours used in the condition. 


1.2 Comparison with the related work 


Our upper bound theorem was inspired by the paper 
of Zielonka [23]. He mentions some savings in memory 
for winning strategies by considering his notion of “useful 
colours”. This observation is sufficient for showing mem- 
oryless determinacy for games with Rabin winning condi- 
tions (see also [7, 13]). In general his bound is not optimal. 
Our upper bound is in some cases exponentially smaller 
than his. Zielonka’s motivation comes from automata the- 
ory so he considers potentially infinite graphs. In this set- 
ting our upper and lower bounds for memory needed by 
winning strategies are optimal. 

Memory requirements in the context of program syn- 
thesis were studied by Lescow [12]. He considers only 


game graphs of size linear in the number of colours and 
seeks a characterisation of winning conditions admitting 
polynomial-size strategies. Our upper bound subsumes all 
his examples of families of such winning conditions. Le- 
scow provides also some 2°(") lower bounds. We improve 
on them, showing an 2(n!) lower bound. This closes the 
gap between previously known lower bounds and the facto- 
rial upper bound of LAR’s. This may come as a slight sur- 
prise, because some claims to the contrary have been quoted 
(see [20], p. 9). 

Finally let us mention the following algorithmic prob- 
lem: given a game and a node, establish whether player 0 
has a winning strategy from this node. McNaughton [15] 
gives an algorithm working in time exponential in the num- 
ber of colours. In case the of games with winning condi- 
tions given in Rabin form, Emerson and Jutla [8] show that 
the problem is NP-complete. From our general upper bound 
on memory we infer a class of winning conditions for which 
the problem is in NP N co-NP (see Corollary 12). This can 
be seen as a generalisation of the result due to Emerson, 
Jutla and Sistla [10], where NP N co-NP upper bound was 
shown for games with Rabin chain (parity) winning con- 
dition. The latter problem is polynomially equivalent to 
the u-calculus model checking [10]. Nerode, Remmel and 
Yakhnis [16] study classes of winning conditions for which 
there exist polynomial time algorithms of strategy synthe- 
sis. We provide (Corollary 13) a broader class of winning 
conditions allowing strategy synthesis in polynomial time. 


2 Preliminaries 


We consider infinite duration games played by two play- 

ers (player 0 and player 1) on finitely coloured graphs called 
arenas. An arenais atuple A = (V, Vo, Vi, E, C, x) where: 
(V, Vi, V2, E) is a (not necessarily finite) bipartite directed 
graph with the partition Vo, Vi; C is a finite set of colours; 
and y : V — C is a partial colouring function. We as- 
sume that for every vertex of the arena there is at least one 
outgoing edge, i.e., for every v € V there is some u € V, 
such that (v,u) € £. Hence every path in the arena can be 
prolonged. 
Remark: In order not to unnecessarily obscure our exam- 
ples we will sometimes have arenas that are not bipartite 
graphs. It will be, however, always straightforward to re- 
store the bipartite property by introducing some new ver- 
tices, but never more than linearly many in the size of the 
arena. 

A game is a pair G = (A, F), where A is an arena, and 
F C P(C) is a winning condition for player O (in Muller 
form [19]). An (infinite) play of the game G is an (infinite) 
sequence 7 = (Uo, U1, V2, . . . } of nodes of A, such that for 
every i = 0,1,2,... we have (vj, vi+1) € E. 


Given an infinite play 7 = (vo, v1, V2,.-.) of a game 


G we define the set of frequent colours of n (denoted by 
Inf (T)) as the set of colours that occur infinitely often in 
the sequence (xv(vo), X(V1); X(V2),---). An infinite play 
T is a winning play for player O if the set of its frequent 
colours is an element of the winning condition for player 0, 
i.e., Inf (a) € F 

A strategy for player 0 in a game G is a partial function 
¢:V* — V, defined for finite plays 7 = (vo, U1,---, Uk) 
with vy, € Vo, such that (v,,¢(7)) € E. A play m = 
(vo, U1, U2,---) from a node vo € Vo is consistent with the 
strategy if C(vo,..-, Voz) = V2i+1 fori = 0,1,.... A strat- 
egy Ç is winning for player 0 from a vertex vo if every in- 
finite play starting from vo consistent with ¢ is winning for 
player 0. 


A winning set for player O is the set of vertices of 
the arena from which there exists a winning strategy for 
player 0. It is easy to see that these strategies can be 
“merged” (see [15]), hence there is also one common win- 
ning strategy on the winning set. 


Proviso: We will consider winning strategies for player 0. 
Thus w.l.o.g. we can assume that player 0 has a strategy to 
win from every vertex of the arena. To meet this require- 
ment it is enough to restrict the arena to the winning set of 
player 0. 


It turns out (see [11, 15, 23]) that for the games we con- 
sider the winning strategies can be realized by functions that 
do not have to refer to the whole histories of the play (i.e., 
the elements of the set V*), but only to a finite information 
about the play so far. To make this precise we introduce the 
notion of strategies with memory. 


Definition 1 (Strategy with memory) Let A = (V,Vo, 
Vı, E,C, x) be an arena. A strategy automaton is an I/O 
automaton 8 = (M, Vo, Vi; mr, =), where M is a fi- 
nite set of (memory) states; Vo, Vi are input and output 
alphabets respectively; my E€ M is the initial state; and 
>C Mx Vox V, x M is the transition relation. If m > m! 


then S being in the state m and racing vo from the input 
outputs vı and changes its state to m’. 


.) is consistent with 8 if there 

.), such that 

mo = my, and m; = mi+1 for every i = 0,1,2,.... 
U2i+1 


A play m = (vo, v1, V2;-- 
is a sequence of memory states (Mmo, M1, M2, .. 


A strategy automaton § realizes a strategy Ç with (fi- 
nite) memory M, defined as follows. For a finite play 
m = (vo,...,U2ķ} consistent with 8 we set Ç(r) = v if 
for the memory m,; obtained as above we have mę 2s m 

v 
and (voz, v) € E. 


In case M is a one element set, we call the strategy mem- 
oryless. 


3 Upper bound 


In this section we are going to determine (Theorem 6) 
for every winning condition F the number m ş such that for 
every game with the winning condition F the memory of 
size mg is sufficient for a winning strategy in this game. 

Let F C P(C) be a winning condition. Define F | D as 
the set {D' € F: D' C D}. 


Definition 2 (Zielonka tree of a winning condition) We 
define the Zielonka tree of F C P(C) (denoted by Zg c) 
inductively: 


1. IfC ¢ F then 23,0 = ZF c where F = P(C) \ F. 


2. If C € F then the root of Zy c is labelled with C. Let 
Co, Ci,- --, Ck—1 be all the maximal sets in {X ¢ F : 
X C C}. Then we attach to the root, as its subtrees, 
the Zielonka trees of F [| Cj, ie. Zsro,,c,, for i = 
0,1,...,k-1. 


The domain of Zş c (denoted by ||Z,c]|) is defined as the 
set of nodes of the tree. The Zielonka tree 24 ,¢ can be for- 
mally seen as the labelling function € : ||Zs,c|| > P(C) 
assigning to every node in the domain its label as defined 
above. In the sequel we will usually write 2 to denote 
Z¢,c, if C is clear from the context. 

A node of 2¢ is a 0-level node if it is labelled with a set 
from F. Otherwise it is a 7-level node. 


1-level ( Ch ) 
wii sen 
0-level re oe 


1-level Gi ... Gin) HD oe Fin) 


Figure 1. Example of a Zielonka tree 


Example: Let Can = {t1,.-.,tn, fi,---, fn}, for every 
n € N. For a boolean function h : {0,1}" — {0,1} 
define a winning condition F, C P(C;,) as the family 
{M,..., Hk} = {{21,. En} C Crs h(i iyan) = 
O and x; € {ti fit}, where # = 1 and f; = 0 for ev- 
ery i = 1,...,n. The root of the Zielonka tree Zs, (c.f. 
Figure 1) is a 1-level node labelled with the set Cn of all 
colours. The k children of the root are 0-level nodes la- 
belled with H,,... , Hp respectively. Every node labelled 
with H; = {hg,... , hin} has n children labelled with the 
sets Hi1, ... , Hin respectively, where Hi; = H; \ {hij}. 
oO 


Let A = (V, Vo, Vi, E, C, x) be an arena. Now we will 
define the notion of an attractor. This will be a subarena of 
the arena. For simplicity in the sequel we will often identify 
subarenas with the sets of their vertices. 


Definition 3 (Attractor) Define the attractor for player i 
of a set T in the subarena W C V (denoted by Attr¥ (T)) 
in the following way. Construct by transfinite induction the 
increasing sequence To, T1, 72,... of sets of vertices: 


e To =TOAW, 


e Tepi = Tg U {ve NAW :vEN T; #0} 
U {vE Vii NW :vE C Te}, 


e if € is a limit ordinal then let Tz = Up<e Ty: 


Set Attri” (T) = Ug Te- 


Remark: It is easy to show (see [15, 23, 20]) that 
Attr¥ (T) is the set of vertices in W from which player i 
can force the play into T using a memoryless strategy. 

Let us consider a game 9 = (A,¥) with the 
winning condition F C P(C) and the arena A = 
(V, Vo, Vi, E, C, X). We enrich the labels of the Zielonka 
tree Zş œ to contain also sub-arenas of A, on which player 
O has winning strategies in respective subgames. We also 
remove those subtrees for which the associated subarenas 
are empty. In this way we obtain the Zielonka tree of the 
game S. 


Definition 4 (Zielonka tree of a game) To define the 
Zielonka tree Zg of the game S we first define another 
labelling V : ||23,c|| + P(V) of the Zielonka tree Zg c. 
The labelling V will assign to the nodes of Zy, œ subarenas 
of V. Hence eventually we will have two labelling func- 
tions: Č as in the definition of 23,¢, and V which we are 
going to define now. 


1. Set V(s) = V if s is the root node, i.e., the root is 
labelled with the set V of all vertices of the arena. 


2. Suppose that for a node s’ the function V(s’) = V” is 
already defined and C(s’) = C’ € F. For every son s” 


of s! we set V(s") = V" \ Attry (x71(C" \ C(s"))). 


3. Suppose that V(s') = V" is already defined and 
C(s’) = C' ¢ F. Let so, 51,..., 8-1 be all the sons 
of s' in Zg, c, and C(s;) = C; for i = 0, 1,...,k — 1. 
Set V(s;) = U; where the sets U; are computed as fol- 
lows: 


Set initially Wo := @ and iterate through € = 
0,1,2,... until We We+1 We+k-1- The 
sequence (We) is defined by transfinite induction. If € 
is a limit ordinal then we set We = U,<¢ Wp, and oth- 
erwise perform the following computations (see Fig- 
ure 2): 


(a) Set Xe = V' \ Attr¥ (We). 
(b) Set Yg = XE \ Attrs€(x71(C’ \ Clemoak))): 


Ay Ye Ag 
The shaded region is equal to We41; Ar = Attry (We); 
Dg = X7} (C" \ Clemoar)); Az = Attri (Dg). 


Figure 2. Calculating We+1 


(c) Take Zę to be the winning set for player 0 in the 
game (A | Y*, F | Ciemoan))- 


(d) Set Wey1 = Attrl (We) U Ze. 
Eventually define U; = U,{Ze : € mod k = i}. 


The domain of the Zielonka tree Zg is defined as ||Z5|| = 
{s € ||Zs,c|| : V(s) # Ø}, i.e., the set of nodes labelled 
by V with a nonempty subarena of V. Each node s of Zg is 
labelled with the pair (C(s), V(s)). 


Definition 5 (Memory of a Zielonka tree) Let 2 be a 
Zielonka tree. A subtree of Z is called a /-subtree, if it 
can be obtained from 2, by leaving at most one child of ev- 
ery 1-level node. We define the memory of Z to be the set 
Mz = {1,2,...,mz}, where mz is the maximal num- 
ber of leaves of a 1-subtree of Z. We will use Ms and 
mg to denote the memory and the size of memory of the 
Zielonka tree Zg. Similarly we will use Mg and mg when 
referring to the memory and the size of memory of the 
tree Zg. Clearly, for a game 9 = (A,¥) we have that 
IIZsll € [|e]. hence mg < ms- 


Theorem 6 (Upper bound) 

For every game G with the winning condition F, player 0 
has a strategy Çg winning from every node of her winning 
set and requiring memory of size at most mg. 


For the rest of this section let us fix a game G = (A, F) 
with the arena A = (V, Vo, Vi, E, C, x). To prove the theo- 
rem we will construct an I/O automaton realizing a strategy 
in this game. This automaton will have mg states. First we 
need some definitions. 


We start with the definition of a numbering of the leaves 
of Zg. Let Z be a Zielonka tree and s € N. We define the 
s-numbering of Z inductively: 


1. If the root of Z is a leaf, then let s be its number. 


2. If the root of Z is a 0-level node, then let Z,..., 24-1 
be all its immediate subtrees. The s-numbering of Z 
is obtained by the s;-numbering of Z; for every i = 
0,..., k — 1, where s; = s + 529 Mg,. 


3. If the root of Z is a 1-level node, then let 2,..., 24-1 
be all its immediate subtrees. The s-numbering of Z 
is obtained by the s-numbering of Z; for every i = 
0,...,k—-1. 


The numbering of the leaves of Zg we are after is simply 
the 1-numbering of Zg. Observe, that this numbering asso- 
ciates with every leaf of the Zielonka tree 2g an element of 
Mg. 

A memory m € Mg does not uniquely determine a path 
from the root down the Zielonka tree Zg. The reason is that 
a memory specifies only branchings at 0-level nodes of the 
tree, i.e., at a O-level node we branch into the only subtree 
that may possibly contain leaves numbered with m. A pair 
(v, m) € V x Mg, however, is just enough to single out 
such a unique path. To determine the “missing” branchings 
at 1-level nodes of Zg, we use the fact, that sets of vertices 
labelling the children of a 1-level node of Zg are pairwise 
disjoint. Thus either we branch to the unique child of a 1- 
level node which is labelled with a set of vertices containing 
v, or we have reached the end of the path if none such a child 
exists. 


Definition 7 (Anchor node) We will say that s € ||Zg]|| is 
the anchor node for (v,m) € V x Ms, if it is the low- 
est node on the unique path for (v, m), as described above, 
such that v belongs to the set of vertices labelling s in the 
Zielonka tree Zg. 


Before we describe the strategy for player 0 in the game 
G, we shall define the memory update function and the next 
move function, which will be the essential components of 
the strategy. 


Definition 8 (Memory update function) We define the 
memory update function pg : V x Mg — Mg. Given 
(v,m) € V x Mg we first find the anchor node s € ||Zs|| 
for (v, m). We define pg (v, m) by cases: 


e If s is a leaf in ||Zg|| or s is a 1-level node then 
pg(v,m) =m. 


e Otherwise s is a 0-level node. Find the son s’ of s, with 
a leaf numbered m in the subtree rooted in s’. Suppose 
it is the 7-th son of s. 


- Ifv € xt (C(s) \ C(s’)) then pg(v, m) = m’, 
where m! € Mg is the lowest number associated 
with a leaf in the ((i +1) mod k)-th subtree of s, 
and k is the number of children of s in Zg. 


- Otherwise pg (v, m) = m. 


Definition 9 (Next move function) We define the next 
move function og : Vo x Mg > Vı. Let (v, m) € V x Mg 
and let s’ be the anchor node for (v, m). Let (C’, V’) be the 
label of s’. We define og (v, m) by cases: 


1. If s' is a leaf in ||Zg]|| then og(v,m) = v’ for some 
v EVNVE. 


2. If s’ is a O-level node, then find the son s” of s’, with 
a leaf numbered m in the subtree rooted in s”. Let 
(C", V") be the label of s” in the Zielonka tree Zg. 


(a) Ifv € y1(C" \ C") then og(v,m) = v’ for 
some v’ € V N vE. 

(b) Otherwise og(v,m) = r(v) where r : Vo — 
Vı is the memoryless strategy “attract to the set 


ECNE 


3. If s’ is a 1-level node and u = max{¢ : v ¢ We} 
(where Wẹ for € = 0,1,2,... are the same as calcu- 
lated in the definition of V(s')), then øg (v, m) = r(v) 
where T : Vo — Vj is the memoryless strategy “attract 
to the set W,,”. 


Remark: According to our proviso, player 0 has a strategy 
from every vertex of the game. With this assumption it can 
be shown (see [23]) that indeed v € Ue We; hence there 
exists u required in the last clause of the above definition. 


Definition 10 (The strategy Cg) The strategy Çg in the 
game Q is realized by the I/O automaton & = 
(Mg, Vo, Vi, Mmr, =}, where my = 1 € Mg and m > m' 


whenever v’, m’ can be “computed” by performing the fol- 
lowing actions: 


e update the memory according to the move of player 1 
(m" = p(v,m)), 


e compute the move to be performed (v' = o (v, m")), 


e update the memory according to this move (m’ = 
plu’, m")). 


The strategy Çg uses memory Mg of size mg < mg (see 
Definition 5). To prove Theorem 6 it remains to show that 
¢g is a winning strategy for player 0. 


Lemma 11 The strategy Çg is winning for player 0. 


Proof 

Consider an infinite play m = (vj, v2,U3,.-.) consistent 
with the strategy Çg and let (m1, M2, msz3,...) be the se- 
quence of corresponding memories, i.e., we have vg; = 
Og (V2j—1; M2j—1) and Mmj = pg(vj,m _1), for every j = 
1,2,..., where mp = mr € Meg is the initial memory of 
Çs. 
Let (51, 2, $3, - - . } be the sequence of the anchor nodes 
for the respective pairs (vj, mj). Define s, to be the root 
of the lowest subtree of Zg containing almost every sj. Let 
(C', V") be the label of sy in Zg. Let (Cj, Vi), for i = 
0,..., k — 1, be the labels of the k children of s+. 


Observation 11.1 s, is a 0-level node. 


Proof: Suppose s, is a l-level node. Let Z for € = 
0,1,2,... be the same as calculated in the definition of 
V(s,,). Every time sx is the anchor node for some (vj, mj) 
the strategy Cg attracts the play to a set Zę with a smaller 
€ than before. We can, however, decrease € only finitely 
many times, so almost every v; belongs to some fixed 
Ze C Vemoak)- Thus almost every s; belongs to the sub- 
tree of Zg rooted at (€ mod &)-th child of s+. This, how- 
ever, contradicts the definition of sy. O 


Observation 11.2 s, 
(sı, S2, 833... ). 


occurs infinitely often in 


Proof: If it did not, then there would exist an i, such that 
for almost every j we would have v; € V;. This contradicts 
the definition of sy. O 

From the definition of s, it is evident that Inf (r) C C". 
From Observations 11.1 and 11.2 it follows that for every 
i =0,...,k— 1 the strategy Cg attracts the play 7 to the set 
x~1(C' \ Ci) infinitely many times, so in fact we have that 
Inf (r) Z Ci. 

As, by Observation 11.1, s is a O-level node, we have 
that Inf(7) € F. Hence Çg is winning for player 0 and 
Theorem 6 is proved. E 


Remark: Note that, in particular, if P(C) \ F is closed 
under union, i.e., F can be expressed by a Rabin condition 
(see [23]), then the strategy Çg is memoryless. Memoryless 
determinacy for such games was shown in [7, 13]. 
Remark: Observe that every l-subtree of a tree from the 
Example on page 4 (Figure 1) has n leaves (labelled with 
Aiy,... , Hin for some i). From Theorem 6 it follows that 
winning strategies for player 0 in every game with such a 
winning condition need at most memory of size O(n). 


Corollary 12 (Complexity of games) The problem 
{(Zs,A, vo) : player 0 has a winning strategy in the game 
(A, F) starting from the vertex vo of the arena A} is in 
NP N co-NP. 


Proof 

Let 9 = (A, F). If player 0 has a winning strategy in 9 then 

the NP-witness is the strategy ¢g. To prove that the problem 

is in NP it suffices to show, that there is a polynomial time 

algorithm to decide if this strategy is winning for player 0. 
Let G = (V x Mg, Eg) be the bipartite graph, such that 

((v,m), (v',m')) € Eg if either: 


e m = m' and (v, v') € Vi x Vo is an edge of the arena 
A, or 


e m= m' holds for the I/O automaton realizing Çs. 
y! 


We restrict G to the vertices reachable from the vertex 
(vo, mz), where mz is the initial memory of Çg. Let the 
colouring of the nodes of G be inherited from the colour- 
ing of the arena A, i.e., y((v,m)) = x(v). Deciding if 
the strategy Cg is winning for player 0 is clearly equiva- 
lent to checking that all the infinite paths in the graph G are 
coloured with sets belonging to F. 

Now we give a short description of an algorithm to per- 
form this task. 

Divide G into strongly connected components (s.c.c.). If 
for some s.c.c. H it holds that ¥(H) ¢ F, then clearly Cg is 
not winning for player 0. 

Otherwise for every s.c.c. H of G find all 0-level nodes 
s € ||Zs||, such that X(H) C C(s), but the inclusion does 
not hold for any of the grandchildren of s. For every such 


s let 81, 82,..., 8, be its children in Zs. For every i = 
1, 2,...,k check recursively if G xt (e(s:))) satisfies 
F | C(s;). oO 


Remark: Corollary 12 can be seen as a generalisation of 
the result of Emerson, Jutla and Sistla [10] that the decision 
problem for games with Rabin chain (parity) conditions is 
in NP N co-NP. In this special case the size of the Zielonka 
tree is linear in the number of colours. 

By a careful analysis of the strategy synthesis algorithm 
implicit in the definition of the strategy Çg one can obtain 
the following fact. 


Corollary 13 (Strategy synthesis algorithm) There is an 
algorithm that given a game 9 = (A, F) computes a win- 
ning strategy for player 0 in time O((|A| + d)”); here d is 
the maximal degree of a node and h is the height of the 
Zielonka tree Zg. 


4 Lower bounds 
4.1 The mş lower bound 


Here we consider the lower bound on the size of memory 
needed by a winning strategy in case when the size of a 
graph is not limited by the number of colours. We show 
that in this case the upper bound of Theorem 6 is tight. 


Theorem 14 (Lower bound) 

For every winning condition F there is an arena Ag such 
that every winning strategy for player 0 in the game (Ag, F) 
requires memory of size at least mg. 


Proof 

Let F C P(C). Assume that C € F. Otherwise we take a 
son s’ of the root, such that, there is a 1-subtree with mg 
leaves below s’. Then we can take the label C” of s' and 
continue our construction for F [ C” instead of F. 

Let T be a 1-subtree of the Zielonka tree Zg with mg 
leaves and let o1,...,0m, be all the leaves of T. We 
define the arena Ag as follows. For every set of colours 
E = {e1,...,e:} we define a subarena Pick(£) as on 
Figure 3(a). In the square (uncoloured) vertex player 1 
makes a choice to visit a vertex coloured with one of the 
colours in E. To facilitate the description of the whole 
arena let us use the sequence of labels on the path lead- 
ing to a node of T to identify this node. A notation 
Cı D1.. . Cn Dn(Cn+1 ) denotes a leaf to which leads a path 
with labels C1 D1 .-. Cn Dn or C,.D,...CyDyCn4i. For 
every leaf o = Ci D1 ...CnDn(Cn+1) of T we define a 
subarena Box(c) as on Figure 3(b). Again, in the square 
(uncoloured) vertex player 1 makes a move. Finally the 
arena Ag is defined as on Figure 3(c), where in the circle 
(uncoloured) vertex player 0 makes a move. 

Observe that a play on the arena Ag consists of an infi- 
nite sequence of the following choices: 


1. Player 0 chooses Box(o) for some leaf o = 
Cı Dı vee Cn Dn(Cn41) of T. 


2. Player 1 chooses one of the indices j € {1,..., n}. 


3. Player 1 picks a vertex coloured with one of the colours 
in Cj and then a vertex coloured with one of the 
colours in C; \ Dj. 


Claim 14.1 Player 0 has a winning strategy in the game 
(As, F): 


Proof: The only significant choices of player 0 are made 
in step 1. In the strategy we are defining her choice will 
depend on the choice made by player 1 in step 2 of the pre- 
ceding round of the play. Suppose that player 0 has chosen 
Box(c) and player 1 has chosen the index j in step 2. Then 
in the next round player 0 chooses Box(o'), where a’ is 
some leaf in the subtree of T rooted in the next child of 
the node C1 D1... C}, after the child C1 D,...CjD;. (If 
Cı Dı... CD}; is the last child of its parent then pick a leaf 
a in the subtree rooted in the first child of C1 D1 ...C;.) 
Now we will argue that the strategy just described is win- 
ning for player 0. Consider a play 7 consistent with the 
strategy. Let y = C,D,...C; be the root of the lowest 
subtree of T containing all the leaves of T chosen infinitely 


BOX(Om,) 


Figure 3. The arena Aş. 


often by player 0 in step 1. Let yj = C,D,...C;D;, for 
j =1,...,k be all the children of y in T. Observe that for 
every j =1,...,k there is a leaf ø; in the subtree rooted in 
yj, Such that the index 7 is chosen by player 1 in step 2 
infinitely often in Box(o;). This, however, implies that 
Inf (x) £ D;, for every j = 1,...,k. On the other hand it 
is not hard to see that Inf (a) C C;, hence Inf (r) € F. O 

If the size of the memory of a strategy for player 0 in the 
game (Ag, F) is less than mg, then clearly there is a leaf 
o of T, such that player 0 playing according to this strategy 
never visits Box(o). Hence, the following claim establishes 
the lower bound of the theorem. 


Claim 14.2 Consider a strategy for player 0 in the game 
(Ag, F) and a leaf o in the tree T. If player 0 never visits 
Box(a) when playing according to the strategy, then the 
strategy is not winning for player 0. 


Proof: Let o = C1 D,...CnDn(Cr41). We will now pro- 
vide a counter-strategy for player 1 allowing him to make 
one of D,;’s the set of frequent colours. Which D; it will 
turn out to be depends on the actual behaviour of the strat- 
egy of player 0. 

To play according to his counter-strategy player 1 keeps 
in his memory a tuple dé Dı x -+ x Dn to remember 
which element of each D; is currently his target. 

Assume that player 0 chooses Box(d) such that ô = 
CD. CD; ... With D; # Dj, i.e., j is the smallest 
index at which o and 6 differ. Player 1 responds making the 
following choices in Box(6): 


1. Choose Pick(C;) and then pick a vertex coloured 
with dj, where (di,... , dn) is the current memory of 
player 1. 


2. From Pick(C; \ Dj) choose a vertex coloured with 
some c € Dj. It is possible to do so, because Dj C C} 


and Dj \ D; # 0. 
After performing these moves player | updates his current 
memory (d1,...,d,) by changing its j-th component to 
the next element of D; in some fixed linear order (or to the 
minimal element of D; in this order, if d; was maximal). 

Now we will argue that this counter-strategy guarantees 
a win for player 1. For a play a formed according to this 
counter-strategy consider the set J of indices j chosen in- 
finitely often in the way described above. Set i = min(J) 
and observe that from some moment of the play m only 
colours in the set D; UDj41 U+ +U Dn = D; appear (recall 
that Dı D Dışı for l = 1,...,n — 1). Moreover, each 
colour of D; is hit infinitely often. Thus Inf (7) = D;. This 
completes the proof since D; is a winning set for player 1. 
oO oO 


Remark: The arena As constructed in the proof of Theo- 
rem 14 is roughly of size mg. Hence, if for a family of con- 
ditions (Fn )}nen the number mg, grows superpolynomially 
in the number of colours of ¥,,, then our lower bound does 
not apply to the case when we restrict ourselves to arenas of 
size polynomial in the number of colours. We do not know 
whether the mg bound is strict in this case. 


4.2 Optimality of the LAR’s 


Now we show a factorial lower bound establishing opti- 
mality of the LAR data structure even for games with arena 
sizes bounded linearly in the number of colours of the win- 
ning condition. Optimality of LAR’s in the case when we 
do not bound the size of the game follows from the previous 
section. 


Theorem 15 (LAR’s are optimal) 

There is a family of games (Sn)nen, such that the arena of 
Gn is of size O(n) and every winning strategy for player 0 
in Gn has memory of size at least n!. 


Proof 
The game §,, has the arena An = (V, Vo, Vi, E, Chn, X), 


where: Vo = {-n,.-..,-1}, V = {1,... n}, E = 
{(-i, j), (i—i) :4,j € 4 cs gry | and Cn = V. We 
identify vertices with colours setting y(v) = v, for ev- 


ery v € V. The winning condition of §,, is defined as 
Fa = {C CC, : [CN V| = max(CnVY)}. 

It is not difficult to see that player 0 has an LAR winning 
strategy in 9n (in fact it suffices to consider LAR’s over 
colours from the set Vo only). 

Suppose that § = (M, Vo, Vi, mz, =) is an I/O automa- 
ton realizing a strategy for player 0. For the sake of this 
proof by the transition graph of $ we will understand the 
graph (M, —) with edges labelled by elements of Vo, where 
m “3 m if there is a vı € V1, such that m > m' holds. 


In the following lemma we slightly eneen the state- 
ment of the theorem, in order for the proof by induction on 
n to go through. 


Lemma 16 Let S be the I/O automaton realizing a winning 
strategy for player 0 in Gn. Then there is a state m € M 
reachable from the initial state of the transition graph of 8, 
and a finite sequence w € Vo" with at least one occurrence 
of every element of Vo, such that: 


1. m 4,m, i.e., the path in the transition graph of the au- 
tomaton §, labelled with the input word w and starting 
in state m is a loop, 


2. |My| > n!, where Mu is the set of states of § on the 
path described above. 


Proof: W.l.0.g. we can assume that the transition graph of 
the automaton $ is strongly connected. Otherwise we could 
restrict the transition graph of § to one of its strongly con- 
nected components (s.c.c.), that is reachable from the initial 
state, and is final in the acyclic graph of all s.c.c.’s of § 
(i.e., there are no edges going out of this s.c.c. in the tran- 
sition graph of 8). As player 1 can in a finite number of 
moves force the play into a reachable final s.c.c., clearly af- 
ter such a restriction the remaining strategy is still winning 
for player 0. 

The base case of the induction follows immediately from 
the assumption that the transition graph of $ is strongly con- 
nected. 

Let Hı, .. ., Hn be sub-games of Gn, such that H; is ob- 
tained by removing —i from Vo and n from Vj. It is easy 
to see that I/O automata $1,...,8,, obtained by straight- 
forward restrictions! of $ realize winning strategies for 
player 0 in games H1, . . . , Hn. From the induction hypoth- 
esis it follows that there are states m ,...,m™, E M, and 


'More precisely, in order to obtain $; we restrict the input alphabet of 
§ to Vo \ {—1}, and change the output component of the transition relation 
whenever it is n to, for example, (n — 1). 


finite sequences w1,...,Wn, such that w; € (Vo \ {—i})* 
and |M;| > (n — 1)!, where M; is the set of states on the 
path m; ai Mi. 

Observe that the outputs produced by & on any path 
mi Z, m; for i = 1,..., do not contain any occurrence 
of n € Vj. Otherwise, the infinite input sequence (w;)” 
would form a play winning for player 1. This, however, 
would contradict the assumption that § realized a winning 
strategy for player 0 in Gn. 

We will now argue, that if i A j then M;N M; = 0. This 
would immediately imply that | Uii M;l >nx(n-1)= 
n!. Assume the contrary, i.e., that there is a state m € Mi; N 
M; for some i Æ j. Then there are partitions w; = u1 - U2 
and wj = vı + V2, such that m; Hem Ba m; and m; =m 
m 3, mj. So there is a loop m a *! am. Hence, the 
infinite input sequence (u2 - Uz > V2 - v1)” induces a play 
winning for player 1, because the sequence wz - Uy - V2 + v1 
contains occurrences of all n elements of Vo, and the output 
generated by § does not contain a occurrence of n € Vj. 
This, however, contradicts the assumption that § realized a 
winning strategy for player 0. 

To finish the proof of the Lemma it remains to show that 
the sequences w; for? = 1,...,m can be composed to yield 
a sequence w, such that m Z, m for some m € M and 
this cycle includes all cycles m; Z, m; as its sub-paths. 
Again, the assumption of strong connectedness of the tran- 
sition graph of § makes this task trivial. O Oo 


5 Polynomially representable strategies 


The lower bound of the previous section indicates that 
the size of the memory of I/O automata realizing winning 
strategies may be inherently big as a function of the size of 
the arena. Here we consider a representation of strategies 
in terms of so called p-automata, which are parallel com- 
positions of I/O automata. It turns out that p-automata are 
capable of encoding strategies in a more succinct way than 
T/O automata. 

One would like to measure the size of a winning strat- 
egy in a game in terms of two parameters: the size of the 
arena and the size of the winning condition. From the per- 
spective of program synthesis it seems natural to assume 
that the arena is given just as a graph. On the other hand 
it is much too restrictive to assume that winning conditions 
are given in Muller form. For example, Rabin conditions 
can be sometimes exponentially more succinct than Muller 
conditions. To avoid these problems of different representa- 
tions we propose to represent winning conditions by means 
of Turing machines, or equivalently, by p-automata. For a 
function p(n), we will say that a family M of winning con- 
ditions is p(n)-recognisable if for every winning condition 
F € M with n colours there exists a p-automaton of size 


p(n) recognizing F. Hence our notion of recognizability 
will be a non-uniform one. We find it more intuitive to ex- 
press this notion in terms of p-automata. 

The main result of this section is that if a family of win- 
ning conditions is p(m)-recognisable for some polynomial 
p(n) then winning strategies in games with these condi- 
tions are representable by polynomial size p-automata. We 
also show that it is difficult to characterize all families of 
winning conditions admitting polynomial size strategies in 
terms of p-automata. For this we recall that it is an open 
problem to show an example of a Boolean function not com- 
putable in nonuniform NC!. Every family of conditions not 
admitting polynomial size strategies would give an example 
of such a function. Hence, although there are many fami- 
lies of winning conditions that do not admit polynomial size 
p-strategies, it is not easy to come across one of them. 


Definition 17 (p-automaton) Let (R;)7_, be a tuple of I/O 
automata, each of the form R; = (Qi, Nin, Nout; qi = i)- 


We assume that there is a special letter r € Sin N Sout. If 
q=—> iq’ then, intuitively, the automaton does not read from 
Qa 
the input; similarly for =>; but then the automaton out- 
T 


puts nothing. A p-automaton is a sequence of I/O automata 
(Ri), together with a set Zegt of external letters. 


One can think of such an automaton as of a parallel com- 
position of automata (R;)}z—ı restricted on actions not in 
Zegt. In other words, it can be considered to be a CCS pro- 
cess: (Rill... |[Rn)\(CSin U Zout) — Lert). The semantics 
of p-automata is based on this intuition. 

A sequence (Ri) and a set egt as above de- 
fine a global I/O automaton R = (Qi X X 
Qn, Xin, Nout, (q1; ---; qn), =>R) with the transition 


function defined by the rules: 
=> Rt; 
a ¢ Next 


(egi Gir JPR Gre 


a, bE Lest 


LPRG GRY 
ody) 


We can use p-automata to succinctly represent languages 
over some alphabet X. For this we let Neg, = X U {tt, ff} 
and say that a word w € &* is accepted by a p-automaton 
if the global automaton outputs tt after reading w. 

A Muller sequence (M,y)nen is a sequence of sets of 
winning conditions, such that every F € M, is a condition 
using at most n colours. 


Definition 18 (Polynomially representable Muller se- 
quence) We say that a Muller sequence (M,,) nen is polyno- 
mially representable if there exists a polynomial p(n), such 


that for every F € Mhp there is a p-automaton of size p(n) 
representing F; here we consider F to be a set of sequences 
of colours. 


We can also use p-automata to succinctly represent “se- 
quential” I/O automata (as in Definition 1). Such an au- 
tomaton §, represented by R, has all the same compo- 
nents as R but the transition relation. This relation is de- 
fined by: ash if there are states g” and g", such that, 


Cage" PR @. In other words, we can read 
T 7 


an input, do some number of r moves, and then give an 
output. 


Definition 19 (Polynomially representable strategies) 
We say that a Muller sequence (Mn}nen has polynomially 
representable strategies if there exists a polynomial p(n), 
such that for every game (A, Fn) with Fn € Mn, there is 
a parallel automaton of size p(|A|) representing a winning 
strategy for player 0 on her winning set. 


Let us give an example of savings that can be made with 
this representation. Consider the game S,, as defined in the 
proof of Theorem 15. Player 0 has a winning strategy in this 
game that consists of keeping LAR memory and choosing a 
number equal to the number of negative integers appearing 
before the change pointer in the LAR (for a description of 
LAR memory see [20]). To implement this strategy using a 
p-automaton, we can take n I/O automata, each for storing 
one coordinate of the LAR. Then we add a component that 
takes care of input/output and of updating the other com- 
ponents. It should be obvious that the size of each of the 
components is linear in n. Hence there is a constant c, s.t., a 
winning strategy in 9n can be represented by a p-automaton 
of size cn. On the other hand Theorem 15 states that every 
“sequential” winning strategy for 9n must have size Q(n!). 

Not every game is so easy. A simple counting argument 
shows: 


Proposition 20 There exists a Muller sequence (M,,) nen 
that does not have polynomially representable strategies. 


Next we will show that every polynomially representable 
Muller sequence has polynomially representable strategies 
and p-automata realizing these strategies can be constructed 
in polynomial time. 


Proposition 21 There exists an algorithm that given 
a game 9 with the arena A and the winning con- 
dition represented by a p-automaton W, constructs 
in time O(poly(|A|,|W|)) a p-automaton R of size 
O(poly (|A|, |W|)) realizing a winning strategy for player 0 
on her winning set. 


Proof 

A careful inspection of the definition of the strategy Çg as- 
sures that given an oracle for recognizing sets in the winning 
condition, the whole winning strategy can be in fact com- 
puted (however not necessarily output) in space polynomial 
in A. The polynomial space Turing machine T computing 
the strategy can be in a straightforward way encoded by a p- 
automaton J of size linear in the size of configurations of T’. 
Hence, to obtain the p-automaton R realizing the strategy Çg 
it is enough to “compose” J and W so that the oracle ques- 
tions of J are answered by W. After “composition” with W 
we finally obtain a p-automaton of size O(poly(| A|, |W|)). 
oO 


Remark: This proposition does not contradict the fact that, 
in general, constructing sequential strategy automata is dif- 
ficult. It may be difficult to construct a sequential strat- 
egy automaton from the parallel one. The reason is that p- 
automaton may sometimes do a long sequence of 7-moves 
before answering the next move. 


Corollary 22 Suppose that a family of winning conditions 
can be recognised by a Turing machine working in a space 
polynomial in the number of colours used in the condition. 
It follows that winning strategies in games with these con- 
ditions can be represented by polynomial size p-automata. 
In particular Rabin or Street winning conditions with the 
number of pairs polynomial in the number of colours admit 
polynomial size strategies. 


It would be tempting to say that if a Muller sequence 
admits polynomially representable strategies then the se- 
quence itself is polynomially representable. This turns out 
to be false. 


Proposition 23 There exists a Muller sequence (Mn nen 
that has polynomially representable strategies, but is not 
polynomially representable. 


Proof 
Take a boolean function h : {0,1}* — {0,1} that is not 
polynomially representable. Define the Muller sequence 
(Mn)nen by Mon-1 = Ó and Mo, = {Fn} for ev- 
ery n = 1,2,..., where Fn is as defined in the example 
on page 4. Clearly the Muller sequence (Mn)nen is not 
polynomially representable. Nevertheless, from the The- 
orem 6 it follows that (Mn)nen has polynomially repre- 
sentable strategies (see the second remark after the proof of 
Lemma 11). Oo 


The problem of characterizing families of winning con- 
ditions having polynomially representable strategies is at 
least as difficult as giving an answer to one of the main 
questions in nonuniform complexity theory. We will now 
show that if we had such a characterisation then we could 


show an example of a function h : {0,1}* — {0, 1} that is 
not computable in nonuniform NC!. This is known to be the 
major open question about nonuniform complexity classes 
(see [2] pp. 763-764 for the description of the problem). 
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Figure 4. The arena of the game G (h, n) 


We show that arbitrary characterisation of Muller se- 
quences having polynomially representable strategies will 
allow us to decide whether a function is computable in 
PSPACE/poly. 

Let h : {0,1}* — {0,1} be a function. For every n 
construct a game G(h, n) as in Figure 4. Player 1 moves in 
square vertices and player 0 in the circle vertex. The set of 
colours is Cn = {t1,---, tn, fi,---; fn, 0, 1}. The winning 
condition is the smallest set closed under union that contains 
the sets {21,...,%n,h(%1,...,En)}; where a; € {t;, fi} 
andt; = 1, f; = 0, foreveryi=1,2...,n. 

It should be clear that player 0 has a winning strategy in 
this game. The simplest one is to give correct answers each 
time. Intuitively also all other strategies should be “aware” 
of the correct values of h. 

If h is computable in PSPACE/poly then, by Proposi- 
tion 21, for every n there is a polynomially representable 
strategy in the game G(h,n). If the strategies for all the 
games are polynomially representable then we claim that h 
is in PSPACE/poly. Let us take n and a p-automaton Rn of 
size p(n) realizing a winning strategy in the game G(h, n). 
To calculate the value of the function h on some arguments 
T1,- --, Zn We simulate a particular play in G(h, n). In this 
play we make player 1 repeatedly choose 21,...,%,, and 
see what are the answers of R, in this play. The first an- 
swer may not be correct but eventually the answers of Rn 
must stabilize at the correct answer. This should happen 
after no more than d steps, where d is the number of con- 
figurations of Rn. It should be clear that this simulation can 
be performed in PSPACE/poly. 
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